Goto

Collaborating Authors

 new trillion-parameter ai language model


Google's new trillion-parameter AI language model is almost 6 times bigger than GPT-3

#artificialintelligence

A trio of researchers from the Google Brain team recently unveiled the next big thing in AI language models: a massive one trillion-parameter transformer system. The next biggest model out there, as far as we're aware, is OpenAI's GPT-3, which uses a measly 175 billion parameters. Background: Language models are capable of performing a variety of functions but perhaps the most popular is the generation of novel text. For example, you can go here and talk to a "philosopher AI" language model that'll attempt to answer any question you ask it (with numerous notable exceptions). While these incredible AI models exist at the cutting-edge of machine learning technology, it's important to remember that they're essentially just performing parlor tricks.